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Abstract. We study the high frequency price dynamics of traded stocks by a model 
of returns using a semi-Markov approach. More precisely we assume that the intraday 
returns are described by a discrete time homogeneous semi-Markov which depends also 
on a memory index. The index is introduced to take into account periods of high and 
low volatility in the market. First of all we derive the equations governing the process 
and then theoretical results are compared with empirical findings from real data. In 
particular we analyzed high frequency data from the Italian stock market from first of 
January 2007 until end of December 2010. 



A semi-Markov model with memory for price changes 



2 



1. Introduction 

Semi-Markov processes (SMP) are a wide class of stochastic processes which generahze 
at the same time both Markov chains and renewal processes. The main advantage 
of SMP is that they allow the use of whatever type of waiting time distribution for 
modeling the time to have a transition from one state to another one. On the contrary, 
Markovian models have constraints on the distribution of the waiting times in the states 
which should be necessarily represented by memoryless distributions (exponential or 
geometric for continuous and discrete time cases respectively). This major flexibility 
has a price to pay: the parameters to be estimated are more numerous. 

Semi-Markov processes generalizes also non-Markovian models based on continuous 
time random walks used extensively in the econophysics community, see for example 
[H [2] . SMP have been used to analyze financial data and to describe different problems 
ranging from credit rating data modeling |3J to the pricing of options [U [6] . 

With the financial industry becoming fully computerized, the amount of recorded 
data, from daily close all the way down to tick-by-tick level, has exploded. Nowadays, 
such tick-by-tick high-frequency data are readily available for practitioners and 
researchers alike [3 E] . It seemed then natural to us trying to verify the semi-Markov 
hypothesis of returns on high-frequency data, see [5]. In that paper we proposed a 
semi-Markov model showing its ability to reproduce some stylized empirical facts such 
for example the absence of autocorrelations in returns and the gain/loss asymmetry. In 
that paper we showed also that the autocorrelation in the square of returns is higher 
with respect to the Markov model. Unfortunately this autocorrelation was still too small 
compared to the empirical one. 

In order to overcome the problem of low autocorrelation, in this paper we propose an 
indexed semi-Markov model for price return. More precisely we assume that the intraday 
returns (up to one minute frequency) are described by a discrete time homogeneous semi- 
Markov process. We introduce a memory index which takes into account the periods 
of different volatility in the market. It is well known that the market volatility is 
autocorrelated, then periods of high (low) volatility may persist for long time. We make 
the hypothesis that the kernel of the semi-Markov process do depend on which level of 
volatility the market is at that time. 

To check whether our hypothesis describes real data we analyzed high frequency 
data from the Italian stock market. By Monte Carlo simulations we generated synthetic 
time series of returns by using the semi-Markov kernel estimated from real data. We 
showed that the synthetic time series are able to reproduce the autocorrelation of the 
square of returns as observed for the real time series. We stress the fact that we model 
returns which are uncorrelated and we obtained correlation in the square of returns. Our 
approach is different from other models like the GARCH family where the volatility is 
modeled directly as an autocorrelated process. 

The database used for the analysis is made of high frequency tick-by-tick price 
data from all the stock in Italian stock market from first of January 2007 until end of 
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December 2010. From prices we then define returns at one minute frequency. 

Tlie plan of the paper is as follows. In Section 2 we define the semi-Markov model 
with memory and we show how to compute its transition probabilities. In Section 3, we 
present the empirical results deriving from the application of our model to real stock 
market data. Finally, in Section 4 we present our conclusion. 

2. The semi-Markov model with memory 

In this section we propose a generalization of the semi-Markov process that is able to 
represent higher-order dependencies between successive observations of a state variable. 
One way to increase the memory of the process is by using high-order semi-Markov 
processes as defined in [10]. Here we propose a more parsimonious model having the 
objective of defining a new model that appropriately describes empirical regularities of 
financial time series. To this end we extend the model proposed in reference [5] allowing 
the possibility of reproducing long-term dependence in the square of stock returns. 
Let {fl,F,P) be a probability space and consider the stochastic process 



with a finite state space E = {1,2, S}. In our framework the random variable J, 
describes the price return process at the n-th transition. 
Let us consider the stochastic process 



with values in IR. The random variable T„ describes the time in which the n-th transition 
of the price return process occurs. 

Let us consider also the stochastic process 



with values in IR. The random variable [/„ describes the value of the index process at 
the n-th transition. 

In reference [H] the process {U„} was defined as a reward accumulation process 
linked to the Markov Renewal Process {J„,T„}. In this paper we introduce a different 
index process that is defined as follows: 



where f : Ex]R^]R is a Borel measurable bounded function and U^^^_^-^y f/™ are 
known and non-random. 

The process can be interpreted as a moving average of the accumulated reward 
process with the function / as a measure of the rate of reward per unit time. 

The function / depends on the state of the system Jn-i-k and on the time s. 




~{m+l), J- -m, -(m-1), •••,-'-l,-'0;-'l;--- 



U-(m+l), U-mi U-(m-l), ■■ -i U^i, Uq, Ui, .. . 




(1) 
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As an example you can think of the case in which m = 1 and /(J™, s) = {JnY- In 
this simple case we have that: 

K = T^rA^^ {{Jn-lf ■ {Tn - T„_l) + {Jn-2f " {Tn-l ' T„_2) ^ , (2) 

which expresses a moving average of order m + 1 = 2 executed on the series of the square 
of returns with weights given by the fractions 

T-a Tji~l Tn—l Tn~2 /„\ 

T} rp T rp rp ' \ J 

n — J-n-2 -Ln — -'n-2 

It should be noted that the order of the moving average is on the number of transitions. 
As a consequence, the moving average is executed on time windows of variable length. 

To construct an indexed model we have to specify a dependence structure between 
the variables. Toward this end we adopt the following assumption: 



P[Jn+i=j, Tn+i-Tn<t\aiJh,n,Uj;'),h = -m,...,0,...,n,Jn = t,U::^ = v] 
= P[J„+i = J, T„+i -T„ < t|J„ = ^,[/™ = v] := Q^{v;t), 

where a{Jh,Th, UJ^), h < n is the natural filtration of the three- variate process. 

The matrix of functions Q'^(f;t) = {Q^{v;t))iji^E has a fundamental role in 
the theory we are going to expose. In recognition of its importance, we call it 
indexed semi-Markov kernel. 

The joint process (J„,T„), which is embedded in the indexed semi-Markov kernel, 
depends on the moving average process U^, the latter acts as a stochastic index. 
Moreover, the index process depends on {Jn,Tn) through the functional relationship 

0- 

To describe the behavior of our model at whatever time t we need to define 
additional stochastic processes. 

Given the three-dimensional process {J„,T„,f/™} and the indexed semi-Markov 
kernel Q'^(f;t), we define by 

N{t) = sup{n eN:Tn<t}] 

Z{t) = JN{t)] 



1 ™ /•iAT(^(,)_,)+i„, 

U^{t) = —— / f{Jmt)-e)-k. s)ds, 

t - llN(t)-e)-m JT,j.„,.,r. 



where TN(t) <t < TN(t)+i and 6 = l{t=Tj^^^^^}. 

The stochastic processes defined in ([s]) represent the number of transitions up to 
time t, the state of the system (price return) at time t and the value of the index process 
(moving average of function of price return) up to t, respectively. We refer to Z(t) as 
an indexed semi-Markov process. 

The process U"^{t) is a generalization of the process where time t can be a 
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transition or a waiting time. It is simple to realize that if Vm, ii t — Tn we have that 
Let 

:=P[J^^,=j\J^ = t,U:^ = v]. 

be the transition probabilities of the embedded indexed Markov chain. It denotes the 
probability that the next transition is in state j given that at current time the process 
entered in state i and the index process is v. It is simple to realize that 

p^iv) = limQ^{v;t). (6) 



Let Hp{v; •) be the sojourn time cumulative distribution in state i e E: 

Hr{v;t) := P[T,+i - < t|Jn = t, = v] = Y,QT,{v-t). (7) 

It expresses the probability to make a transition from state i with sojourn time less 
or equal to t given the indexed process is v. 

The conditional waiting time distribution function G expresses the following 
probability: 

GT^iv- 1) := p[r„+i - r„ < i I j„ = = j, c/r = (8) 

It is simple to estabhsh that 

1 ifp-M = o. 

To properly assess the probabilistic behavior of the system, we introduce the 
transition probability function: 

^Ti-(rn+i),i-rn,...io-,j)i^-{rn+l),t-m,---,to]t,V) : = 

P[Z{t) = j, U'^{t) < V\Jo = io, J-(m+l) = 'i'-{m+l),To = to, ...,T_(^+i) = 

(10) 

In next proposition we show that the transition probability function of our indexed 
semi-Markov process satisfies a renewal-type equation. This is an important point 
because the proposition clearly indicates the mathematical apparatus needed to extend 
the theoretical investigation of the model. Anyway, the reader can safely skip the proof 
because the empirical results, illustrated in next section, are obtained via simulation 
techniques. 

Before we present a lemma which is a required step in the proof of the proposition. 
For simplicity of notation set to — hereafter. 
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Lemma 1 For all states j, io, i-(^m+i), for all times t, to, and for any value 
V &JR it results that: 

P[Z(t) = j, U^(t) <V,Ti < t\Jo = io, J-(m+l) = «-(m+l),7o = 0, = t-(^rn+l)] 



l{Ti<t,Jiv(Ti)eE}- 



P[Z{t) = j, U'^{t) < V\Ti, Jn{Ti), Jo = ^0, J-{m+l) = i-{m+l),To = 0, ...,T'_(^+i) = 

(11) 

Proof First of all we remember a property of the conditional expectation. Let X be a 
random variable and let A be an event, then 

E[P[A\X]] = P[A]. (12) 

A direct application of this property together with the fact that the events 
{Jn{Ti) — k} are a set of pairwise disjoint events whose union is the entire sample 
space, produces 

P[Z{t) = j, U"^{t) <V,Ti < t\Jo = io, J-{m+l) = i-{m+l):To = 0, ...,T'_(^+i) = 



E 



P[Z{t) = j, U"\t) <V,Ti< t, Jn{Ti) £ E\Ti, Jn{Ti), Jo = io, J-(m+i) = "^-(m+i), 



, To — 0, TL(^+i) — 



E 



eE}- 



P[Z{t) = j, U"^{t) < V\Ti, Jn{Ti), Jo = ^0, J-{m+i) = i-(m+i):To = 0, ...,T'_(^+i) = 

Proposition 2 The probabilities (f)'^ ^ +i)i-m io-j)(^-("J+i)' ^-"i' ^' ^) ^^'l/?/ ^he 
following equation: 

^Ti-(^+i),i-m,-io;j)(^-(m+l): t-m, ■■; 0; t, V) 

-t-m-l ^ it_,_i ) I Er=i ( Jo fiio,s)ds+!^]_l'' fit.k,s)ds<v) 

(13) 

Proof First of all let us compute the value of the index process U"^{0) given the 
information set {Jq = io, J-{m+i) = ^-(m+i),^o = ^o, ■■■,T_(rn+i) = Because 
t = = To is a transition time, we have that 9 — 1. Moreover T_i_^ = t-i-m and \/k 
T_fe = t^k < t- Then, we have that 

C/-(0) = J2 / f(i-k-u s)ds. (14) 



k=0 "^t-k-i 
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Now, being the events {Ti > t} and {Ti < t} disjoint, it follows that 

P[Z{t) = j, f/™(t) <V\Jo = io, J-{m+l) = i~{m+l),To = 0, T_(m+i) = t_(m+l)] 
= P[Z{t) = j, U"^{t) < V, Ti > t\Jo = io, = i~{m+l),To = 0, T_(m+i) = t-(m+l 

+ -Pl^l*^) = J' < ^5^1 < ^l-'o = "^05 •••5 </-(m+l) = i-{m+l),To = 0, ...,T_(m+i) = t_(„t+l) 

(15) 

Observe that 

P[Z(t) = j, U"^(t) <V,Ti> t\Jo = io, J_(m+i) = i_(m+i),To = 0, ...,T_(m+i) = 

= P[Ti > t| Jo = "^0; J-{m+l) = "^-(m+l), ^0 = 0, T_(m+i) = t_(m+l)] 

■ = h U"'{t) < V\Ti > t, Jo = ^05 •••5 </-(m+l) = '^-(m+l)!^0 = 0, ...,T_(m+i) = 

(16) 

The first factor on the right hand side of (16) is 

P[Ti > t| Jo = io, J~{m+1) = i-(m+l), ^0 = 0, = t-(m+l)] = 1 " Hi^^{U"^ (0); t) 

m „j 



(17) 



The second factor on the right hand side of (16) is 



P[Z{t) = j,U"'{t) < V\Ti >t,Jo = Zo,..., J-{m+l) = i-{m+l),To = 0, ...,T_(„+i) = t_(m+i)] 
= P[U"^{t) < V\Z{t) = j, Ti > t, Jq = io, J_(m+1) = ^0 = 0, T_(m,+ 1) = 

■ = il^l > t,Jo = io, J_(m+1) = i-(m+l),71) = 0, ...,T_(m+i) = 

(18) 

Now, observe that, Ti > t means that the time of next transition exceeds t and, 
therefore, up to t the process remains in state io- Consequently, 

P[Zit) = j\Ti > t,Jo = io, J_(m+1) = i-{m+l),To = 0, ...,T_(m,+l) = = ^ioj- 

Moreover, because t ^ Tj^{t) we have that 9 = and consequently 



2 »Ti /•tATjv(t)+i_fc 

t - lN{t)-m JTt^^t)-!^ 



Since Ti > t, we have that T/v(t) = To = and by substitution we get in U'^it) - 
-j—^ — XlfcLo It''^^ '' f^'^-ki s)ds. Finally, T_fc = t_k and J_fc = i^fc, for all k, produces 



^ JO Jt^f^ 



In formula (19) we computed the value of the U^{t) process given the information 
set {Ti > t,Jo = io,...,J-(m+i) = i-(m+i),To = 0, r_(^+i) = t_^rn+i)}; this proves 
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that the random variable U"^{t) is cr(Jo, J-(m+i),Ti,To, T_(m+i))-nieasurable. 
By using the properties of the indicator function we have that: 

P[U"^{t) < V\Z{t) = j,Ti > t, Jo = io, J-(m+l) = ^-(m+l),To = 0, ...,T_(m+i) = t-(m+l)] 
= £'[l|[7m(j)<y}|Z(t) = j,Ti > t,jQ = if), J_(m+1) = i-(m+l),To = 0, ...,T_(m+l) = 

(20) 

To evaluate the expectation in formula (20), note again that the conditions 
{Z{t) = j,Ti > t,jQ = iq) are only compatible for Z{t) = i^, then the value of the 
process U"^{t) is that expressed in formula (19). Then we can express (20) as follows: 



--E 



l{(7™(t)<y}|^(^) — j^Ti > t,jQ — io, J-{m+l) — 'i-{m+l),TQ — 0, ...,T_(m+l) — t-{m+l) 



m „t 



t-t. 



k=l 



J2[ / fi^o,s)ds + 



f{i-k, s)ds 



(21) 



Now let us consider the computation of the second addend on the right hand side 
of formula ( 15 ) . By Lemma ([T| we know that 

P[Z{t) = j, U'^it) < y, Ti < t| Jo = "^0, J-{m+l) = 'i-{m+l),To = 0, ...,T_(m,+ i) = 

P[Z{t) = j, [/""{t) < V\Ti, Jn(Ti),Jo = "^0, •••5 J-{m+l) = '>'-{m+l),To = 0, ...,T_(m+l) = t-(m+l) 

(22) 

Because the random variable U"^{0) is <j{Jo, J„(m+i),To, T_(m+i))-measurable, see 
formula (14), then formula (22) is equivalent to formula (23) 

= E 



?7"(0) 



-'JV(Ti) 

1 



^ / f{i-k~i,s)ds, 

k=0 "'*-fe-i 



(23) 



Jq — "^0; J~{m+1) — ^ - {m+1) , Ti , Tq — 0, T_(m+i) — t^(^rn+l)] 

Now observe that 



P[TiG(r,r + dr),JAr(ri) = s|t/™(0) 



/ f{i^k^i,s)ds, 



Jq — "^0; J-{m+l) — "^-(m+l)! ^0 — 0, T_(m+1) — ^-(m+l)] 

1 



P[Ti G (r, r + Jr), J;v(TO = s|f/'"(0) = — / f{i-k-u s)ds, Jo = Zo 



fc=0 



m 
20 s 



k=o 



^ / f{i-k-i,s)ds;dT 



(24) 



A semi-Markov model with memory for price changes 



9 



Moreover notice that 



0,...,T_ 



(m+l) 



P[Z{t)=3,U"\t)<V\T,,J, 



N{Ti), Jo 



in J- 



,To = 0,...,T_ 



{i-m,---,io,JN{Tj 



,0,T,;t-Ti,V). 



(25) 

Then, after an integration over the possible values of Ti G (0, t] and a summation 
over the values of JNiTi) ^ E, formula (22) becomes equal to 



{«_„,..., jo,s;i)V''-m, 



(t_„,...,0,r;t-r,\/). 



(26) 



A substitution in (15) completes the proof. 



Proposition |2] gives a renewal-type equation for transition probabilities and 
represents a generalization of the evolution equation for transition probabilities of the 
semi-Markov process. Equation ( 13 ) could be used for asymptotic analysis in order to 
obtain explicit representation of the autocorrelation function. Moreover the numerical 
solution of equation (13), based on quadrature formulas, could represent an alternative 
to the simulative approach used in the next section. 



3. Empirical results 

To check the validity of our model we perform a comparison of the behavior of real data 
returns and returns generated through Monte Carlo simulations based on the model. 
In this section we describe the database of real data used for the analysis, the method 
used to simulate synthetic returns time series and, at the end, we compare results from 
real and simulated data. 



3.1. Database description 

The data we used in this work are tick-by-tick quotes of indexes and stocks downloaded 
from www.borsaitaliana.it for the period January 2007-December 2010 (4 full years). 
The data have been re-sampled to have 1 minute frequency. Consider a single day (say 
day k with 1 < k < d) where d is number of traded days in the time series. In our 
case we consider four years of trading (from the first of January 2007 corresponding to 
d = 1076). The market in Italy fixes the opening price at a random time in the first 
minute after 9 am, continuous trading starts immediately after and ends just before 5.25 
pm, finally the closing price is fixed just after 5.30 pm. Therefore, let us define S{t) as 
the price of the last trading before 9.01.00 am , S(t + 1) as the price of the last trading 
before 9.02.00 am and so on until S{nk) as the price of the last trading before 5.25.00 
pm. If there are no transactions in the minute, the price remains unchanged (even in 
the case the title is suspended and reopened in the same day). Also define S{nk + 1) as 
the opening price and S{nk) as the closing price. With this choice n = 507. There was 
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1 2 3 4 5 

state 



Figure 1. Number of transitions for the embedded Markov cliain 

a small difference before the 28th of September 2009 since continuous trading started 
at 9,05 am, and therefore prior of that date we have n = 502. Finally, if the title has a 
delay in opening or it closes in advance (suspended but not reopened), only the effective 
trading minutes are taken into account. In this case n will be smaller than 507. The 
number of returns analyzed is then roughly 508000 for each stock. We analyzed all the 
stocks in the FTSEMIB which are the 40 most capitalized stocks in the Italian stock 
market. 

To be able to model returns as a semi-Markov process the state space has to be 
discretized. In the example shown in this work we discretized returns into 5 states 
chosen to be symmetrical with respect to returns equal zero. Returns are in fact already 
discretized in real data due to the discretization of stock prices which is fixed by each 
stock exchange and depends on the value of the stock. Just to make an example, in the 
Italian stock market for stocks with value between 5.0001 and 10 euros the minimum 
variation is fixed to 0.005 euros (usually called tick). We then tried to remain as much 
as possible close to this discretization. In Figure [T] we show an example of the number 
of transition from state i to all other states for the embedded Markov chain. 

3.2. Monte Carlo simulations 

In the model described in the previous section and in particular in the definition of the 
index process t/™ the function / : x IR — IR is any Borel measurable bounded function. 
To perform simulations, we choose a function which is both motivated by simplicity (we 
want to keep the model as simple as possible) and by real market behavior. 

Let us briefly remind that volatility of real market is long range positively 
autocorrelated and then clustered in time. This implies that, in the stock market, there 
are periods of high and low volatility. Motivated by this empirical facts we suppose that 
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also the transition probabilities depends on whether the market is in a high volatility 
period or in a low one. We then fixed the function / to be the square of returns and the 
index to be a moving average of this values as described in the example given in eq. 
|2]but with different values of the memory m. Note that the memory is the number of 
transitions. The index [7™ obtained from the given definition of / was also discretized 
into 5 states of low, medium low, medium, medium high and high volatility. 

According to these choices we estimated, from real data, the probabilities Q^{v] t) 
defined in formula Q for different values of m. For the results shown below m was 
chosen to run from 5 to 200 transitions with a step of 5. 

Then, this probabilities have been used to simulate synthetic time series of returns 
needed to compare results from real data and the model as described in the next section. 
Note that these are step-by-step simulations in which the index U"^ has to be calculated 
from the last m simulated transitions. 



3. 3. Results on autocorrelation function 

A very important feature of stock market data is that, while returns are uncorrelated 
and show an i.i.d. like behavior, their square or absolute values are long range correlated. 
It is very important that theoretical models of returns do reproduce this features. We 
then tested our model to check whether it is able to reproduce such behavior. Given the 
presence of the parameter m in the index function, we also tested the autocorrelation 
behavior as a function of m. 

If R indicates returns, the time lagged (r) autocorrelation of the square of returns 
is defined as 

Cov{R\t + T),R\t)) 
^^"^ = Var{R^{t)) ^'^^ 

We estimated S(r) for real data and for returns time series simulated with different 
values of the memory m. The time lag r was made to run from 1 minute up to 100 
minutes. Note that to be able to compare results for S(r) each simulated time series 
was generated with the same length as real data. Results for few values of m, for real 
data and for a semi-Markov model without index are shown in Figure |2} 

As expected, real data do show a long range correlation of volatility let us than 
analyze results for the synthetic time series. The simple semi-Markov model starts at the 
same value but the persistence is very short and after few time steps the autocorrelation 
decrease to zero. A very interesting behavior is instead shown by the semi-Markov 
models with memory index. If a small memory (m = 10 in the shown example) is 
used, the autocorrelation is already persistent but again decreases faster than real data. 
With a longer memory (m = 30) the autocorrelation remain high for a very long period 
and also its value is very close to that of real data. If m is increased further the 
autocorrelation drops again to small values. This behavior suggest the existence of an 
optimal memory m. In our opinion one can justify this behavior by saying that short 
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time lag (min) 



Figure 2. Autocorrelation functions of real data (solid line) and of 4 synthetic time 
series as described in the label. 



memories are not enough to identify in which volatihty status is the market, too long 
memories mix together different status and then much of the information is lost in 
the average. All this is shown in Figure [3] where the mean square error between each 
autocorrelation function of simulated time series and the autocorrelation function of the 
real data as a function of m is computed. It can be noticed that there exist an optimal 
value of the memory m that makes the autocorrelation of simulated data closer to that 
of real data. 

4. Conclusions 

We have modeled financial price changes through a semi-Markov model where we have 
added a memory index. Our work is motivated by two main results: the existence in 
the market of periods of low and high volatility and our previous work [3], where we 
showed that the semi-Markov model, even if more realistic than a simple Markov model, 
is not able to capture all the correlation in the square of returns present in real data. 
The results presented here show that the semi-Markov kernel is influenced by the past 
volatility. In fact, if the past volatility is used as a memory index, the model is able 
to reproduce quite well the behavior of market returns: the returns generated by the 
model are uncorrelated while the square of returns present a long range correlation very 
similar to that of real data. 

We have also shown that the time length of the memory does play a crucial role in 
reproducing the right autocorrelation's persistence indicating the existence of an optimal 
value. 

We stress that out model is very different from those of the ARCH/GARCH family. 
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100 

memory (m) 



Figure 3. Mean square error between autocorrelation function of real data and 
synthetic data as a function of the memory value m. 



We do not model directly the volatility as a correlated process. We model returns and 
by considering the semi-Markov kernel conditioned by a memory index the volatility 
correlation comes out freely. 
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